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Abstract 



We investigate the power of Algebraic Branching Programs (ABPs) augmented with 
help polynomials, and constant-depth Boolean circuits augmented with help functions. We 
■ relate the problem of proving explicit lower bounds in both these models to the Remote 

Point Problem (introduced in [3]). More precisely, proving lower bounds for ABPs with 
help polynomials is related to the Remote Point Problem w.r.t. the rank metric, and 
for constant-depth circuits with help functions it is related to the Remote Point Problem 
w.r.t. the Hamming metric. For algebraic branching programs with help polynomials with 
some degree restrictions we show exponential size lower bounds for explicit polynomials. 



On 
O 

1 Introduction 

X 

hi 

The goal of circuit complexity, which is central to computational complexity, is proving lower 
bounds for explicit functions. The area has made several advances in the last three decades 
mainly for restricted circuit models. Some of the major results relating to circuit size lower 
bounds are the following: Exponential size lower bounds for constant-depth Boolean circuits 
[12l [6] and for monotone Boolean circuits [21 [11] computing certain explicit Boolean func- 
tions; in the arithmetic circuit complexity setting, exponential size lower bounds for mono- 
tone arithmetic circuits [8] computing certain explicit polynomials, and exponential size lower 
bounds for explicit polynomials in the case of noncommutative algebraic branching programs 
[9|. More recently, [10] has shown superpolynomial lower bounds for multilinear arithmetic 
circuits. We can say that these restricted models of computation have been sufficiently well 
understood to show the nontrivial explicit lower bounds. 

However, most of the central problems in the area continue to remain open. For example, 
we do not know how to prove superlinear size lower bounds for logarithmic depth Boolean 
circuits. We do not have superpolynomial size lower bounds for depth-3 arithmetic circuits 
over rationals. 
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The aim of this paper is to explore circuit complexity by augmenting the power of some 
of these restricted models by allowing help functions (in the arithmetic circuit case, help 
polynomials). In this paper we consider two specific problems. 

1. Proving size lower bounds for constant depth Boolean circuits augmented with help 
functions. More precisely, given any set {hi,h2,--- , hm} of help Boolean functions 
where 

hi : {0, 1}» — - {0, 1}, 

and m is (quasi)polynomial in n, we want to find an explicit Boolean function / : 
{0, l} n — ► {0, 1} that requires super polynomial size constant depth circuits C that 
takes as input x±, ■ ■ ■ , x n , hi, ■ ■ ■ , h m . The function / should be explicit in the sense 
that it is computable in 2 n ° W time. 

2. Proving size lower bounds for noncommutative algebraic branching programs augmented 
with help polynomials. More precisely, given any set {hi, hi, ■ ■ ■ , h m } of help polyno- 
mials in the noncommuting variables {xi,X2, • ■ ■ , x n } over a field F, we consider alge- 
braic branching programs whose edges are labeled by F-linear combinations of the hi. 
The problem is to prove superpolynomial lower bounds for some explicit polynomial in 
xi, ■ ■ ■ ,x n over F. 

We formally define explicit Boolean functions and explicit polynomials. 

We say that a family of Boolean functions {f n }n>o, where /„ : {0, l} n — ► {0, 1} for each 
n, is explicit if there is a uniform 2 n ° (1> time algorithm that takes x G {0, l} n as input and 
computes f n (x). 

We say that a family of multilinear polynomials {Pn}n>o where P n {x) £ F[xi,-- - ,x n ] is 
explicit if there is a uniform 2 n ° (1) time algorithm that takes as input (m, n ) for a multi- 
linear monomial m (on indeterminates x%, xi, ■ ■ ■ , x n ) and outputs the coefficient of m in the 
polynomial P n . 

Contributions of this paper 

For constant-depth circuits and noncommutative ABPs, augmented with help func- 
tions/polynomials respectively, proving lower bounds appears to be nontrivial. 

1. We show that both the above lower bound problems are related to the Remote Point 
Problem studied by Alon et al [3]. For constant-depth circuits we show a connection to 
the Remote Point Problem in the Hamming metric studied in [3j. For noncommutative 
ABPs the problem is connected to the Remote Point Problem in the rank metric which 
is defined as the rank distance between matrices. 

2. We also study the Remote Point Problem in the Rank metric, and we build on ideas 
from Alon et al's work (for the Hamming metric version) in [3] to give a deterministic 
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polynomial-time algorithm for certain parameters. However, these parameters are not 
sufficient to prove lower bounds for ABPs augmented with help polynomials. Similarly, 
the parameters achieved by the algorithm in |3j for the Hamming metric are not sufficient 
to prove explicit lower bounds for constant-depth circuits with help functions. 

3. On the positive side, when the degrees of the help polynomials are somewhat restricted, 
using our solution to the Remote Point Problem w.r.t. the rank metric, we show expo- 
nential size lower bounds for noncommutative ABPs computing certain explicit poly- 
nomials (e.g. Theorem I14p . 

2 Constant Depth Circuits with Help Functions 

In this section, we address the problem of proving lower bounds for constant depth circuits 
of polynomial size that have access to help functions {hi, h 2 , • • • , h m } at the input level. Our 
goal is to show how the problem is related to the Remote Point Problem w.r.t. the Hamming 
metric. 

Notice that we can consider the circuit inputs xi,x 2 ,--- ,x n to be included in the set of 
help functions. Thus, we can assume that we consider constant depth circuits with input 
hi, h 2 , ■ ■ ■ , h m and our goal is to prove superpolynomial lower bounds for such circuits. Notice 
that we cannot predetermine a hard Boolean function as the hard function chosen will depend 
on h 1 ,h 2 ,--- ,h m . 

It is well known that constant depth circuits can be well approximated by polylogarithmic 
degree polynomials, for different notions of approximation. We state the results of Tarui [13] 
(also see [3]) in the form that we require. In what follows, the field we work in will be ¥%, 
but our results can be stated over any constant sized field, and over the rationals. 

A polynomial p{xi, x 2 , ■ ■ ■ ,x n , r±, ■ ■ ■ , r^) is called a probabilistic polynomial if it has as input 
the standard input bits xi, x 2 , ■ ■ ■ ,x n and, in addition, random input bits ri, r 2 , ■ ■ ■ , r&. We 
say that the polynomial p represents a Boolean function / : {0, l} n — * {0, 1} with error e if 

Prob[p(zi, ■ ■ • ,x n ,ri, ■ ■ ■ ,r k ) = f(xi, ■ ■ ■ ,x n )] 

>l-e, 

where the probability is over random choices of bits rj. 

Theorem 1. [13113] There ) of degree 

0(log(l/e) log 2 n) with 0(log(l/e) log 2 n) random bits that represents OR(xi, ■ ■ ■ ,x n ) with 
error e. Furthermore, AND{xi, ■ ■ ■ ,x n ) can be similarly represented. 

Building on the above, the following well-known theorem is shown in [13} 13]. 

Theorem 2. [131 [3] Every function f computed by a boolean circuit of depth d and 
size s is represented by a probabilistic polynomial p(xi,x 2 , ■ ■ ■ ,x n ,ri,--- ,r^) of degree 
0(log(l/e) log 2 n) d that represents f(x\, • • • , x n ) with error se. 

^Tarui's construction yields a probabilistic polynomial q with integer coefficients. We can obtain the desired 
polynomial p over F2 from q by reducing the coefficients modulo 2. 
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Now, consider Boolean functions computed by constant-depth circuits with help func- 
tions. More precisely, let H = {hi,h 2 ,- • ■ ,h m } denote a set of Boolean help functions 
hi : {0, l} n — ► {0,1}. For s,d £ N, we define SizeDepth^ (s, d) to be the set of Boolean 
functions / : {0, l} n — ► {0, 1} such that there is a depth d circuit C of size at most s such 
that 

f(x) = C(hi(x), h 2 (x), • • • , h m (x)), 

where x denotes the n-tuple (xi,x 2 , • • • ,x n ). The lower bound problem is to construct, for 
each fixed d, and for any given set of help functions H and s E N, an explicit Boolean function 
g such that g is not in SizeDepth^ (s, d). 

We do not have a solution to this problem. However, we show that this lower bound problem 
is connected to the Remote Point Problem (RPP) introduced by Alon et al [3j. An interesting 
deterministic algorithm for RPP is presented in [3] . A deterministic algorithm with somewhat 
stronger parameters would solve our lower bound question. We now explain this connection. 

The Remote Point Problem (RPP) |3j. Given a ^-dimensional subspace V C F^ the 
problem is to find a vector v £ F^ such that the Hamming distance d(u, v) > r for every 
u £ V if it exists,. We will call an efficient algorithm that does this an (JV, k, resolution to 
the problem. 

The challenge is to give an efficient deterministic algorithm for RPP. A randomized algorithm 
that simply picks v at random would be a good solution with high probability (for most 

parameters k and r of interest). Alon et al in [3] give an (JV, k, r) solution for r = O ( E^&k. j ; 

where their deterministic algorithm runs in time polynomial in N. We now state and prove 
the connection between RPP and our lower bound question. 

Theorem 3. Let N = 2 n . For any constant d £ N, and any constants cq > c\ > c 2 > 
such that Co > (c\ + 2c 2 )d + c 2 , if the Remote Point Problem with parameters (N, k, r) - for 
k = 2( lo s n ) c ° and r = 2(lo ^ )C1 - can be solved in time 2 n ° {1 \ then, for any given set of help 
functions H such that \H\ = 2( logn ) C2 and s = cn c , there is an explicit Boolean function that 
does not belong to SizeDepth^(s, d) for large enough n (depending on c). 

Proof. The proof is an easy application of Theorem [2 Let H = {hi, h 2 , . . . , h m }. Con- 
sider a circuit C corresponding to the class SizeDepth^(s, d). To wit, the function it com- 
putes is C(hi(x), h 2 (x), ■ ■ ■ ,h m (x)), where C is depth-d, unbounded fanin and of size cm c . 
Now, for x picked uniformly at random from {0, 1}" suppose the probability distribution 
of (hi(x), h 2 (x), ■ ■ ■ ,h m (x)) on the set {0, l} m is /i. By Theorem [2] there is a probabilis- 
tic polynomial p(yi,y 2 , ■ ■ ■ , y m , ri, r 2 , ■ ■ ■ ,r t ) of degree 0(log(l/e) log 2 m) d that represents 
C{yi,y 2 , ■ ■ ■ ,y m ) with error cm c e. By a standard averaging argument it follows that we can 
fix the random bits r±, r 2 , ■ ■ ■ ,rt to get 

Prob[p(yi,y 2 , • • • ,y m ,n,r 2 , ■ ■ ■ ,r t ) = 

C(yi,y 2 , • • • , y m )\ > 1 - cm c e, 
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where (yi,y 2 , • • • ,Um) 1S picked according to distribution \x. But that is equivalent to 

Prob[p(/ii(x), • • • , h m (x),r 1 ,r 2 , ■■■ ,r t ) = 

C(hx(x), h 2 (x), • • • , h m (x))] > 1 - cm c e, 

(1) 

where x is picked uniformly at random from {0, l} n . 

Choose c' < Co — C2 and c' x > c\{> c 2 ) such that c' = ( C ; + 2c 2 )d. Let e = Then the 

2(logn) 1 

degree of p above is O(logn) c o. We will consider Boolean functions on n bits as vectors in F^. 
Let V be the subspace in F^ spanned by all monomials (i.e, products of help functions) of 

degree at most O(logn) c o. Then the dimension k of V is m°^ ogn ^ < 2( los ™) c ° . By Inequality 
dH), it follows that finding a vector v £ F^ that is r-far from V for r = 2(lo ^^i > cNm c e in 

time 2 n ° (1) would give us an explicit Boolean function that is not in SizeDepth^(s, d). □ 

Remark 4. We recall a nice related result of Jin-Yi Cat: He has shown in [5] an expo- 
nential lower bound for the size of constant- depth circuits that computes m specific parities 
in the presence of (any) m — 1 help functions, where m < n 1 / 5 . His proof is essentially 
based on Smolensky's dimension argument However, in our setting where we allow for 
polynomially many help functions Smolensky's argument llty does not work. 

We now state an interesting connection between explicit lower bounds against 
SizeDepthj^ (n c , d) and lower bounds against the polynomial time many-one closure of AC . 
The proof proceeds by a simple diagonalization argument. For any complexity class C, let 
1Zm{C) denote the polynomial-time many-one closure of C, i.e, the class of languages that can 
be reduced in polynomial time to a language in C. 

Theorem 5. Suppose, for every fixed d £ N, there is a 2 n ° (1> time algorithm A that takes 
as input a set of help functions H = {hi : {0,1}™ — > {0, 1} | i £ [m]} where m < n logn 
(where each hi is given by its truth-table), and A outputs the truth-table of a Boolean function 
g : {0, l} n — > {0, 1} such that for any c > 0, g £ SizeDepthjy (n c , d) for almost all n. Then 
EXP^7^(AC°). 

Proof. For any d G N, let AC denote the class of languages that are accepted by polynomial- 
sized circuit families of polynomial size and depth d. 

Note that to prove that EXP £ 7^(AC°), it suffices to prove that EXP £ ^(AC^) for each 
fixed d 6 N, since EXP contains problems that are complete for it under polynomial-time 
many-one reductions. We will now describe, for any fixed d £ N, an EXP machine that 
accepts a language £ TZm(AC^). 

We proceed by diagonalization. Let R%, R 2 , R3, . . . be any standard enumeration of all 
polynomial-time many-one reductions such that each reduction appears infinitely often in 

*Here, log n can be replaced by any function / : N — > N such that f(n) is 2™ ' '-time computable, f(n) = 
w(l), and f(n) < 
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the list. Fix n G N and let m = max yg { 0j i}n \R n (y)\. On an input x G {0, l} n , the EXP ma- 
chine does the following: for each y G {0, 1}™, it runs i? n for n logn time and computes R n {y) 
(if i? n does not halt in time n logn , the machine outputs and halts). It can thus produce the 
truth tables of functions hi : {0, l} n — > {0, 1} (i G [to]) such that for each y G {0, l} n , /i«(n) is 
the ith bit of R n {y) if |-Rn(n)| > £ and otherwise. Now, by assumption, in time 2 n ° (1> , the 
EXP machine can compute the truth table of a function g n : {0, l} n — > {0, 1} such that, for 
any c > 0, g n ^ SizeDepthj^ fem }(n c , cf) for large enough n. Having computed <7„, the EXP 
machine just outputs g n {x). 

It is clear, by a standard argument, that cannot be polynomial-time many-one reduced to 
any language in AC°. □ 



3 Noncommutative Algebraic Branching Programs 

Let X = {xi,X2, • • • ,x n } be a set of n noncommuting variables, and ¥{X) denote the non- 
commutative ring of polynomials over X with coefficients from the field F. For / 6 ¥(X), 
let d(f) denote the degree of /. Let Mon^(X) be the set of degree d monomials over X. For 
a polynomial / and a monomial to over X, let /(m) denote the coefficient of m in /. A 
nonempty subset H C F(X) is homogeneous if there is a d G N such that all the polynomials 
in H are homogeneous of degree d. 

Let G = (V, E) be a directed acyclic graph. For u,v £ V, let "P M)1 , be the set of paths from u 
to v, where a path in V u ,v is a tuple of the form ((no, u\), (ni, 112), ■ ■ ■ , itj)) where no = it 

and n/ = v. 

Definition 6. Let X = {x\, X2, ■ ■ ■ , x n } and Y = {yi, ?/2, . . . , y m } be disjoint variable sets. 
Let H = {h±, h2, ■ ■ ■ , h m } C ¥(X). An Algebraic Branching Program (ABP) with help 
polynomials H is a layered directed acyclic graph A with a source s and a sink t. Every edge 
e of A is labeled by a linear form L(e) in variables X UY. If L(e) = Y2i a 'i x 'i + J2j PjVjt the 
polynomial L'(e) associated with edge e is obtained by substituting hj for yj, 1 < j < m, in 
L(e). I.e. L'(e) = J2i a i x i + YljPjhj- The size of A is the number of vertices in A. 

Given a path 7 = (ei, e2, . . . , ei) in A, define the polynomial / 7 = L'{e\) ■ L'(e2) ■ . . . ■ L'(et) 
(note that the order of multiplication is important). For vertices n and v of A, we define the 
polynomial f UjV = Y^-y£V u v A- ^ ne ABP A computes the polynomial f S: t- 

Suppose L(e) = Yli a i x % + Ylj PjVj- We say that the edge e is homogeneously labeled if all the 
polynomials in the set {xi \ on 7^ 0} U {hj \ f3j 7^ 0} are homogeneous and of the same degree 
d{e). If the above set is empty, we let d(e) = 0. Now, suppose all edges of an ABP A are 
homogeneously labeled; then, for a path 7 = (ei, e2, . . . , &t) in A let ^(7) = Yll=i ^i e i)- The 
ABP A with help polynomials H is homogeneous if: 

• all the edges in A are homogeneously labeled, 

• For all n, v in A and 71,72 G 7^, d(7i) = ^(72)- 
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For a homogeneous ABP A with help polynomials and any pair of vertices u, v in A, the 
polynomial computed from u to v is homogeneous. 

In the absence of help polynomials, this gives the standard Algebraic Branching Programs as 
defined in, e.g. Nisan [9j. Nisan [9] has shown explicit lower bounds, e.g. for the Permanent 
and Determinant, for this model of computation. Our aim is to prove lower bounds for ABPs 
with help polynomials. 

We show that any ABP with arbitrary help polynomials computing a homogeneous polynomial 
can be transformed into an equivalent homogeneous ABP with homogeneous help polynomials 
with only a small increase in size. Thus, it suffices to prove lower bounds against homogeneous 
ABPs with help polynomials. Fix the help polynomial set H C ¥(X). Let m = \H\ and 
d(H) = maxh£Hd(h). Also, fix some d 6 N. 

Given / S ¥(X) and i £ N, let /W denote the ith homogeneous part of h. For 2 < i < d, 
let Hi = j/iW £ ¥(X) | h £ let H = ^J 2< ^ -Hj. Let rhi denote for each i, and let fh 
denote \H\ = We sh° w the following homogenization theorem. 

Theorem 7. Given any ABP A using the help polynomials H computing a homogeneous 
polynomial f of degree d > 1, there is a homogeneous ABP A using the help polynomials H 
that computes the same polynomial as A, where the size of A is at most S(d+ 1), where S 
denotes the size of A. 



Proof. The following construction is fairly standard. Let s and t be the designated source 
and sink, respectively, of the ABP. We will use the notation of Section [3l 

We now define A. A will use the variables XUY, where Y = 1 < i < m, 2 < j < d(hi)\. 

The vertices of A are tuples (u, i), where u is a vertex of A and i £ N is a number between 
and d. The source of A will be (s, 0) and the sink (t, d). We will define the set of edges of A 
in two stages. We will first construct an ABP on the set of vertices of A which will include 
edges with weights from F (i.e, edges e such that L(e) is a non-zero degree polynomial), 
and we will then show how to remove these edges from the ABP. Consider any edge e in the 
ABP A; let the label L(e) of e be Yl7=l aiXi + Sjli PjVj an d < k < d, define the linear 
form L(e)k - which captures the kth homogeneous part of L'(e), the polynomial computed 
by edge e - as follows: 

• If k = 0, define L(e)& to be the field element X^jLi ftjhf ■ 

• If k = 1, define L(e)k to be Ya=i a * x « + Sj^i Pjhf ■ 

• If k > 1, define L(e)k to be X^=i PjVj 

Fix any vertex (v, k) of A. Let {u±,U2, ■ ■ ■ , u{\ be the predecessors of v in A and let denote 
the edge (ui, v). Then, it is easy to see that 

/ k 
t=l j=0 
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Hence, we define edges ejj in A from vertices (ui,j) to (v,k) with label L(eij) = L{e-j)k-j- 
(Note that the label L(ej&) is just a field element. We will change this presently.) This 
concludes the first stage. Note that, since we only add edges from (u, i) to (v, j) when (u,v) 
is an edge in A, the graph of A is acyclic. Also note that an edge e is labeled by a field 
element if and only if it connects vertices of the form (u, k) and (v, k), for some u, v, and k. 
Finally, it is easily seen from the definition of A that the polynomial computed from (s, 0) to 
(u, i) is the polynomial fs% for any s, u, and i. 

In the second stage, we will get rid of those edges in A such that L(e) £ F. We do this in 
two passes. Fix some topological ordering of the vertices of A, and order the edges (u, v) 
of A lexicographically. As long as there is an edge e = (u, v) of A such that v is not the 
designated sink (t, d) and L(e) £ F, we let e be the least such edge and do the following: we 
remove the edge e, and for each edge e' = (v, w) of A going out of v, we change the label of 
the edge e" = (u,w) to L(e") + L(e) ■ L(e') (if no such edge e" exists, we add this edge to 
the ABP and give it the label L(e) ■ L(e')). It should be clear that the homogeneity of the 
ABP is preserved. After at most 0((sd) 2 ) many such modifications, all edges in A that are 
labeled by field elements are of the form (u, (t,d)). Moreover, by the above construction, it 
is clear that u = (u,d) for some vertex u ^ t of A. Since d > 1, we know that u / (s,0), 
the designated source node. We also know that there are no edges into u which are labeled 
by a field element. We now do the following: for each edge e = (u, (t, d)) labeled by a field 
element, we remove the vertex u and for each edge e' = (v,u), we remove e' and change the 
label of e" = (v, (t,d)) to L(e") + L(e') ■ L(e) (if no such e" exists, we add such an edge e" 
and set its label to L(e') ■ L(e)). This concludes the construction. 

It is easy to prove inductively that after every modification of A, the polynomial computed 
from (s,0) to (t, d) remains Hence, the ABP A computes exactly the polynomial / 

computed by A. Also, by construction, the edges of A are all homogeneously labeled; finally, 
it can also be seen that given a path 7 from vertex (u,i) to vertex (v,j) in A, d{^f) = j — i: 
hence, the ABP is indeed homogeneous, and we are done. □ 

4 Decomposition of Communication Matrices 

We now generalize the key lemma of Nisan [S] that connects the size of noncommutative ABPs 
for an / £ ¥(X) to the ranks of certain communication matrices Mfc(/). The generalization 
is for noncommutative ABPs with help polynomials, and it gives a more complicated connec- 
tion between the size of ABPs to the ranks of certain matrices. For usual noncommutative 
ABPs considered in [9], Nisan's lemma directly yields the lower bounds. In our case, this 
generalization allows us to formulate the lower bound problem as a Remote Point Problem 
for the rank metric. 

We will assume that the explicit polynomial for which we will be proving lower bounds 
is homogeneous. Thus, by Theorem [7] we can assume that each help polynomial in H = 
{hi, h,2, ■ ■ ■ , h m } is homogeneous and of degree at least 2. 

We first fix some notation. Let d G N be an even number. Let d(H) = max/jgg d(h). Also, 
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for 2 < % < d(H), let Hi = {h G H \ d{h) = i}. 

Suppose / G ¥{X) is homogeneous of even degree d > 2, and k G N such that < k < d. We 
define the n k x n d ~ k matrix Mk(f) (as in [9]): Each row is labeled by a distinct monomial 
in Monfc(X) and each column by a distinct monomial in Mon^-j^X). Given monomials 
mi G Monfc(X) and m,2 G Mon ( ^_/ c (X), the (mi, m2)th entry of Mk(f) is the coefficient of the 
monomial m±m2 in / and is denoted by M(,(/)(mi, TI2). 

Call M an [l, m) -matrix if M is an n' x n m matrix with entries from F, where the rows of 
M are labeled by monomials in Mon/(AT) and columns by monomials in Mon m (X). Suppose 
< I < k and < m < d — k. Let M\ be an (I, m)-matrix and M2 a (k — l,(d — k) — m)- 
matrix. We define the (k, d — /c)-matrix M = M\ ®\ m M2 as follows: Suppose m\ G Monfc(X) 
and m2 G Monrf_fc(X) are monomials such that m\ = m\\m\i with m\\ G Monfc_;(X) and 
?77i2 G Mon^(X) and 7772 = 7772177722 with 77721 G Mon m (X) and 77722 G Mon^_^)_ m (X). Then 
the (mi, m2) th entry of M is defined as 

M(mi,m 2 ) = Mi (77712, 77721) • ^(ttjh, 77722). 

Let A be a homogeneous ABP with help polynomials H computing a polynomial / of degree 
d. Let u, v and t/j be vertices in the ABP A, and 71 G V u ,v and 72 G T^ic be paths. We 
denote by 71 o 72 G V u , w the concatenation of 71 and 72 . 

Since A is homogeneous, each of the polynomials f uv for vertices u, v of A is homogeneous. 
For 1 < k < d/2, define the k-cut of A, C k C U as follows: A vertex v G is 

in Ck iff d(f StV ) = k, and an edge e = (u, G E{A) is in Cfc iff d(f S)U ) < k and d(f s>v ) > k. 
For each x £ Ck, let 7^ denote the set of s-t paths passing through x. Clearly, the sets 
{V x I x G Ck} partition V s ,ti the set of all paths from s to t. Thus, we have 

/ = £ £ a 

= £ EA+ £ E/r 

t>eC fc nV(A) 76^ eeC fc n£(A) 76"P e 

(2) 

We now analyze Equation [2j For v G n V(-A), T 3 ,, = {71 o 72 | 71 G V s ,vil2 G V v ,t\- Hence, 
for any v £ C k C] V(A): 

E a = E /71072 = E /71 ■ /t2 

7G^ 7l6P»,« 7lS'P s ,„ 

l2&Vv,t 726Pu,i 

= fs,vfv,t- 

(3) 

Similarly, for any edge e = (u,v) G C fe n -E(A), P e = {71 o (e) o 72 | 71 G V s ,u,l2 G P v ,t}, 
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where (e) denotes the path containing just the edge e. Thus, 



J2&Pv,t 



(4) 

&Vs,u 

■.ep v ,t 

Y f-n ' L '( e ) ' /t2 
fs,uL\e)f Vjt . 

(5) 



From Equations [21 O and [U we get 

f ^ ^ fs,vfv,t 

vec k nv(A) 
Y fs,uL'(e)f v> f 

e=(u,v)£C k nE(A) 

As A is homogeneous of degree d, each polynomial in the sums above is homogeneous of 
degree d. Hence 

M k (f) = Yl M k(fs,vfv,t) + 
vdC k fW(A) 

Y M k (f s , u L'(e)f v , t ). 

e=(u,v)£C k r\E(A) 

(6) 

For any v £ C k Pi ^(^4), / Si „ and /^t are homogeneous degree k and d — k polynomials 
respectively. We denote by M v the matrix M k (f s ,vfv,t)- Notice that for mi £ Monfc(X) and 
m 2 G Mon d _ fc (X), the (m 1 ,m 2 ) th entry of the matrix M„ = M k (f SjV f v j) is /^(mi)/^^). 
Thus, M„ is an outer product of two column vectors and is hence a matrix of rank at most 
1. Therefore, the first summation in Equation [6] is a matrix of rank at most \C k H y(^4)| . 

For e = (u,v) £ Ck H -E(-A), we know that d(f S:U ) < k and d(f SjV ) > k and thus, d(e) > 2. 
Hence, £'(e) = YlheH d ( } Pe,hh, for G F. Therefore, expanding the second summation in 
Equation [6j we get 

Y M k (f s , u L'(e)f v , t ) = 

e=(u,v)£ 
C k nE(A) 

Y Y Pe,hM k (f s , u -h-f v , t ) 

e=(u,v)£ h£H d ( ej 
C k nE(A) 

(7) 

Consider a term of the form M k (f StU hf V) t)- For the rest of the proof let d(w) denote d{f S)W ), 
for any vertex w of A. Given monomials m\\ € Mon d( - M )(X), m 12 € Mon fc _ d ( u )(X), 777,21 £ 
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Mon d ( /l )_( fe _ d ( u ))(X) ; and m 22 G Mon d _ d („)(X), the entry M k (f S;U hf V)t )(rn 11 mi2,m 2 im22) = 
/i(mi2m2i)/s iU (mn)/„ i t(m22), since all polynomials involved are homogeneous. Hence, the 
matrix M k (f StU hf Vit ) is precisely M k _ d ^(h) ® h k -d(u),d(h)-(k-d(u)) M ^ where M e (m n ,m 22 ) = 
fs,u(jnu)f Vt t(m22), for m u £ Mon d(u) {X),m 22 G Mon d _ d(u )(X). Clearly, M e is a matrix of 
rank at most 1, for any e £ C k D E(A) and h £ H d ^ e y Continuing with the above calculation, 
we get 

E M k (f SiU L'(e)f v , t ) 

e=(u,v)£ 
C k nE(A) 



e=(u,v)E heH d ^ 
C k r\E{A) 

d 2 (h) 

E E M i( h ) ®Uh)-i 

heHi=d l (h) 



E A.hMe, 



e=(ii,i))£Cfc : 
d{e)=d(h) 
d(u)=k—i 



where di(h) = max{l, d{h) — (d — k)}, d 2 (h) = mm{d(h) — l,k}, l e = k — d(u), and m e 
d(h) - {k-d{u)). 

Plugging the above observations into Equation [UJ we have 



mi) | E M A + 

K veC k nV(A) 



M' 



( 



d 2 (h) 

E E M ^v® 

heHi=d 1 {h) 



k 

i,d(h)~i 



\ 



E Pz,hM e 



e={u,v)dCk- 
, d{e)=d{h) 
\ d(u)=k—i 



J 



M 



i,h 



Notice that M' above has rank at most |^(A)|, and M' ih has rank at most \E{A)\ < \V(A)\ 2 
for any h £ H and d\{h) <i< d 2 {h). Hence, we have proved the following result: 

Theorem 8. Let A be a homogeneous ABP of size S computing a (homogeneous) polynomial 
f of degree d using the help polynomials H. Then, for any k £ {0, 1, . . . ,d}, we can write 
M k (f) as: 

d 2 (h) 

M k (f) = M'+ E E M i( h )®Uh)-i M U, 

heHi=d 1 (h) 

where di(h) = max{l, d(h) — (d — k)} and d 2 {h) = min{d(h) — 1, k} such that rank(M') < S 
and rank(M l / h ) < S 2 for each h £ H , and i £ {max{l, d(h) — (d — k)} . . . , min{d(h) — 1, k}}. 
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5 Remote Point Problem for the rank metric 



We now introduce an algorithmic problem that will help us prove lower bounds on the sizes 
of ABPs computing explicit polynomials using a (given) set of help polynomials H. This 
problem is actually the Remote Point Problem for matrices in the rank metric that we denote 
RMP. This problem is analogous to the Remote Point Problem (RPP), which we discussed 
in Section [21 

Given two matrices P, Q E F axb , the Rank distance between P and Q is defined to be rank(P— 
Q). It is known that this defines a metric, known as the rank metric on the set of all a x b 
matrices over F. 

The RMP problem. Given as input a set of N x N matrices P±, P 2 , . . . , Pk over a field 
F and r E N, the problem is to compute an N x N matrix P such that for any matrix 
P' = J2i=i a iPi m t ne subspace generated by Pi, P2, . . . , Pk, the rank distance between P 
and P' is at least r. 

In the problem N is taken as the input size, and k and r are usually functions of N. We say 
that the RMP problem has an (iV, k, resolution over F if there is a deterministic algorithm 
that runs in time polynomial in N and computes a matrix P that is at rank distance at least 
r from the subspace generated by the P\ , P2 , . . . , Pk ■ 

Remark 9. How does a solution to RMP give us an explicit noncommutative polynomial f for 
which we can show lower bounds for the sizes of noncommutative ABPs with help polynomials? 
We now explain the connection. 

Let A be a homogeneous ABP of size S computing a polynomial f of degree d. Let d\(h) 
denote max{l, d(h) — d/2} and d 2 (h) denote mm{d/2,d(h) — 1}. For a,b,p,q E N such that 
p E [n a ] and q E [n b ] , let be the n a x n b elementary matrix with 1 as (p, q) th entry, and 

p E [n a ],(/ E [n b ]^ span all matrices in ¥ na><nb . By Theorem 



elsewhere. The matrices \ 
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d 2 (h) 

M d/2 (f)=M'+Yl E M ^KV* M v- 

heH i=d 1 (h) 



where rank(M') < S. For heH and i E {d\(h), . . . , ^(/i)}, the matrix M- h is an n d l 2 1 x 
n d/2-d(h)+i di mens i on matrix. We can write M- h as a linear combination of the elementary 
matrices in {E P d f 2 _ hd/2 _ d{h)+i | p E [n d / 2 ~%qe [ n d / 2 -^)+*]}. 

Let A be the set of matrices of the form Mj(/i) ^d%-i d/2-d(h)+i> w ^ ere h £L H , 

i E {d\(h), . . . , d2(h)}, and p E [n d / 2 ~ % ], q E [ n d / 2 -" ! W+' t ] . Each matrix in A is an n d l 2 x n d l 2 
matrix, with its rows and columns labeled by monomials in Mon^ ■ Every matrix of the 

form Mi(h) ® d J d ^_i M' ih is a linear combination of matrices in A. Crucially, note that A 
depends only on the set of help polynomials and the parameter d, and it does not depend on 
the ABP A. 

By substitution for M' ih we obtain the following expression for M d / 2 (f) in terms of linear 
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combination of matrices in A. 



M d/2 (f) =M'+J2 »mM, 

where au £ ^ '■ Since, M' has rank at most S, it implies that M^^if) * s a ^ rank distance at 
most S from the subspace generated by the matrices in A. Thus, if we can compute a matrix 
M in deterministic time polynomial in n d that has rank distance S = 2°^ from the subspace 
generated by A we would obtain an explicit homogeneous degree d polynomial f with lower 
bound 2^( n ) by setting M = M^/ 2 (/)- This is the approach that we will take for proving lower 
bounds. 

We present the following simple algorithm, which suffices for our lower bound application. 

Theorem 10. For any k, the RMP has an (N,k, [N/k + lj ) -solution over any field ¥ such 
that field operations in ¥ and Gaussian elimination over ¥ can be performed in polynomial 
time. 

Proof. We assume that k < N; otherwise the problem is trivial. Let r denote [N/k + lj . 
Choose the first r column vectors in each of the matrices P\ , P2 , ■ ■ ■ , Pfc . Let v\ , V2 , . . . , v r k £ 
¥ N be these vectors in some order. As rk < N — r, using Gaussian elimination, we can 
efficiently choose v r k+i, v r f.+2, ■ ■ ■ , v r (k+l) £ ^ with the following property: for every i G 
[k + 1], v r k+i is linearly independent of Vi,V2, ■ ■ ■ ,Vrk+(i—l)' Let P be any matrix that has 
iyjfc+1, tVfc+2) • • • > v r(k+i) as its first r columns. It is not too difficult to see that given any 
matrix P' in the subspace generated by Pi, P2, ■ ■ ■ , Pfe, the first r columns of P — P' remain 
independent, i.e rank(P — P') > r. □ 

Remark 11. The Remote Point Problem is fascinating as an algorithmic question. In J3}/ 
Alon et al provide a nontrivial algorithm for RPP in the Hamming metric (over ¥2). We use 
similar methods to provide an improved solution to RMP for small prime fields. The result is 
proved in Section^ Unfortunately, the improvement in parameters over the trivial solution 
above is not enough to translate into an appreciably better lower bound. 

6 Lower bounds for ABPs with Help Polynomials 

In this section, we prove some lower bounds for ABPs computing some explicit polynomials 
using a set of given help polynomials H. Here, 'explicit' means that the coefficients of the 
polynomial can be written down in time polynomial in the number of coefficients of the input 
(the help polynomials H) and the output (the hard to compute polynomial). 

Throughout this section, F will be a field over which field operations and Gaussian elimination 
can be performed efficiently. Let the set of help polynomials be H = {hi,h,2, ■ ■ ■ ,h m }; let 
d(H) = max-heHd(h). 

We will first consider the case of homogeneous ABPs using the help polynomials H; H is, 
in this case, assumed to be a set of homogeneous polynomials. We will then derive a lower 
bound for general ABPs and a general set of help polynomials using Theorem [71 
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6.1 The homogeneous case 

Let H be a set of homogeneous polynomials in this section. Our aim is to produce, for any 
degree d G N, an explicit homogeneous polynomial of degree d that cannot be computed 
by homogeneous ABPs. To avoid some trivialities, we will assume that d is even. 

We first observe that, to compute homogeneous polynomials of degree d, a homogeneous ABP 
cannot meaningfully use help polynomials of degree greater than d: 

Lemma 12. Let A be a homogeneous ABP using the help polynomials H to compute a 
polynomial f of degree d. Then, there is a homogeneous ABP A' , of size at most the size of 
A, such that A' computes f and furthermore, for every edge e G E(A'), d(e) < d. 

Proof. Simply take A and throw away all edges e G E(A) such that d(e) > d; call the resulting 
homogeneous ABP A'. Since A is homogeneous, no path from source to sink in A can contain 
an edge e that was removed above. Hence, the polynomial computed remains the same. □ 

Hence, to prove a lower bound for an explicit homogeneous polynomial of degree d, it suffices 
to prove a lower bound on the sizes of ABPs computing this polynomial using the help 
polynomials H<d = {h £ H \ d{h) < d}. As above, let d^H^d) = max/ lg ^ <d d(h). 

We begin with a simple explicit lower bound. Call a homogeneous polynomial F G ¥(X) of 
degree d d-full-rank if rank(M^ 2 (^ 1 )) = n d l 2 . Full-rank polynomials are easily constructed; 
here is a simple example of one: F(X) = X^meMon d 2 (X) 771 ' m - ^ follows easily from Nisan's 
result [9j that, without any help polynomials, homogeneous ABPs computing any (i-full-rank 
polynomial are of size at least n d l 2 . 

Theorem 13. Assume that d(H<d) < d(l — e), for a fixed constant e > and let F G ¥{X) 
be a d-full-rank polynomial. Then, any homogeneous ABP A computing F has size at least 
-/V2md). 

Proof. Consider a homogeneous ABP A computing F using the help polynomials H . By the 
above lemma, we may assume that A uses only the polynomials H<d- Let S denote the size of 
A. For any h G i?<d, let d\{h) denote max{l, d(h) — d/2} and d2{h) denote min{d/2, d(h) — 1}. 
By Theorem [HI we know that 

d 2 (h) 

M d/2 {F)=M'+ Y, E M i( h )® d iAh)-i<h 

h&H< d i=d 1 (h) 

where rank(M') < S and vank(M- h ) < S 2 , for each h G H<d and i G {d±(h), . . . ,d-2,(h)}. For 
any h and any i such that < i < d(h), rank(Mj(/i)) < mm{n l , n d ( h }~ 1 } , which is at most 
n d{h)/2 ^ n d(H< d )/2_ gy our assum ption on d(H<d), we see that rank(Mj(/i)) < n^ 1 ~ € ' d / 2 . 

By the definition of ®id(h)-v i m P nes that rank(Mj(/i) ^Mh)-i ^Ih) — r a n k(Mj(/i)) • 
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Y&nk(M- h ), which is at most n^ 1 e W 2 S 2 . Thus, we see that 

d 2 (h) 

rank(M d/2 (F))<S + £ £ n^ d ' 2 S 2 

heH< d i=di (h) 

<S + \H< d \dn^ d ' 2 S 2 
< 2mdS 2 n^ d / 2 

As F is (i-full-rank, this implies that 

2mdS 2 n^ d l 2 > n d l 2 

ed 
Tl 4 

.'. S > 



y/2md 

□ 



The above theorem tells us that as long as the help polynomials are not too many in number 
(m = n°( rf ) will do), and of degree at most (1 — e)d, then any full rank polynomial remains 
hard to compute for ABPs with these help polynomials. 

We now consider the case when d(H< d ) can be as large as d. In this case, we are unable to 
come up with an unconditional explicit lower bound. A strong solution to the RMP introduced 
in Section [5] would give us such a bound. However, with the suboptimal solution of Theorem 
[TOl we are able to come up with explicit lower bounds in a special case. Let 5(H) denote 
min^g/f d(h). By assuming some lower bounds on 5(H), we are able to compute an explicit 
hard function. 

Theorem 14. Assume 5(H) > (| + e)d, for a fixed constant e > 0. Then, there exists an 
explicit homogeneous polynomial F £ ¥(X) of degree d such that any homogeneous ABP A 
computing F using the help polynomials H has size at least \n~ /2md\. 



Proof. Let A be a homogeneous ABP A of size S computing a polynomial / of degree d. 
Let d\(h) denote max{l, d(h) — d/2} and d2(h) denote min{d/2, d(h) — 1}. As explained in 
Remark [fj let E^'? denote the n a x n 6 -sized elementary matrix with 1 in the (p, q)th entry 

and 0s elsewhere. The matrices p £ [n a ],q £ [n b ]^ span all n a x n b matrices. 

By Theorem [8] 

d 2 {h) 

M d/2 (f) = M'+ E M *( h )®Z 2 (h)-iKk 

h£H< d i=di(h) 

where rank(M') < 5. As explained in Remark El M' ih is an n d / 2 ~ 1 x n d / 2 ~ d ( h )+ i dimension 
matrix and is in the span of {-E^-i d/2-d(h)+J' w here p £ [n d / 2 ~' l ],q £ [ n <v2-d(h)+i]_ 

Let A denote the set of n d l 2 x n d l 2 matrices of the form Mi(h) 4 ^d'/2-i d/2-d(h)+v 

where h £ H< d , i £ {di(h), . . -,d 2 (h)}, and p £ [n d / 2 -% q £ [ n d/^-d(h)+i^ Then 

we obtain 

M d/2 (f) = M'+ Y, <*mM, (8) 
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where oim £ Since M 1 is a matrix of rank at most 5, this implies that M is at rank distance 
at most S from the subspace generated by the matrices in A. 

Let k = \A\. For each h £ H and i £ (di(/t), . . . , cIqQi)}, we have added precisely n d ~ d( - h ^ 

d /2 

many matrices of the form Mi(h) <8>j d (M_^ where .E is an elementary matrix of dimension 
n d/2-i x n d/2-d(h)+i_ g ince ^ > d (i + e ) for each /j G ^ d c H, this implies that A; < 

mdn2^~ e \ Let Af denote n rf//2 ; .A consists of /c < mdN 1 ~ e N x N matrices. By Theorem [T0| 
we can, in time poly(iV), come up with an N x N matrix Mq that is at rank distance at least 
LiTiJ from the subspace generated by the matrices in A. We label the rows and columns of 
Mq by monomials from Mon^^AT), i n the same way as the matrices in A are labeled. Using 
Mq, we define the homogeneous degree d polynomial F £ ¥(X) to be the unique polynomial 
such that M^/ 2 (-^) = Mq; that is, given any monomial m £ Mon^(X) such that m = mi ■ m,2 
for mi,?ri2 £ Mon d /2p0> F(m) is defined to be Mo(mi,m2). 

Let A be a homogeneous ABP of size S computing F using the help polynomials H. Then, 
by Equation [8] we have 

M d/2 (F) = M'+J2 ®mM 
MeA 

where a a/ £ ^, and rank(M') < S. Since Md/2(F) is Mq, which is at rank distance at least 
[N/(k + 1)J from the subspace generate by .4, we see that S > rank(M') > [N/(k + 1)J . This 
implies that, 



N 








ed 

n 2 




> 








mdN 1 ~ e + 1 


2md 




2md 



□ 

Remark 15. The rather unnatural condition on 6(H) above can be removed with better solu- 
tions to the RMP problem. Specifically, one can show along the above lines that if the RMP 
has an (N, k, N / k 1 l 2 ~ t )-solution for k = N 2S , then for any H, there is an explicit polynomial 
that cannot be computed by any ABP A using H of size at most n^ ed "> / (md)°^ . Here, e and 
6 are arbitrary constants in (0,1). 



6.2 The inhomogeneous case 



Let H denote the set of all homogeneous parts of degree at least 2 obtained from polynomials 



in H , i.e H 



Note that H = [j 







j 



j £ [m], 2 < i < d(hj)Y For 2 < i < d(H), let H { = \h £ H 
Hi. 



d(h) = i}. 



2<i<d(H) 



As in the previous subsection, we construct explicit hard polynomials for even d £ N. Let 
H<d denote [^2<i<d^i ^ d < d(H), and H otherwise. 

Corollary 16. Assume d(H<d) < d(l — e), for a fixed constant e > 0. Then, there is an 
explicit homogeneous polynomial F of degree d such that any ABP that computes F using the 

help polynomials H has size at least 



cd 
IT 



/2md(d+l) 
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Proof. Let F be a <i-full-rank polynomial, as defined in Section 16.11 Consider any ABP A 
computing F using H. By Theorem there exists a homogeneous ABP A computing F using 
H, where the size of A is at most S(d+1). By Lemma [T21 we may assume that A uses only the 
help polynomials in H<j. Since 

\H<d\ < md, Theorem Q3] tells us that S(d+1) > nT/^md 2 , 
which implies the result. □ 

Corollary 17. Let 5(H) = mia^g d(h), and assume 5(H) > (5 + e)d /or a /ixed constant 
e > 0. Then, there exists an explicit homogeneous polynomial F £ ¥(X) of degree d such that 

ed 

any ABP A computing F using the help polynomials H has size at least ^j-j- 



Proof. By Theorem [7J given any ABP A of size S computing a homogeneous polynomial of 
degree d, there is a homogeneous ABP A of size at most S(d + 1) that computes the same 
polynomial as A using the help polynomials H. By Lemma [T2l we may assume that A only 
uses the help polynomials H<d- Now, let F be the explicit polynomial from Theorem 1 141 with 
H<d taking on the role of H in the statement of the theorem; since |i?<d| < md, Theorem [T41 

tells us that S(d+ 1) > [n^~ /2md 2 \, which implies the result. □ 



7 A better solution to the RMP 



Following the approach of Alon et al [3], who provide a nontrivial algorithm for RPP in the 
Hamming metric (over F2), we improve on the parameters of Theorem 1101 for the RMP over 
small prime fields. It is interesting to note that in our solution we get similar parameters as 
[3 J . As mentioned earlier, the improvement in parameters over the simple solution of Theorem 
[TU1 is too little to give us a much better lower bound. 

Throughout this section, F will denote a constant-sized field. The main result is stated below. 

Theorem 18. For any fixed constant c > 0, the RMP has an (N, IN, r)- solution over any 
constant- sized field F and for any I, r > such that £ ■ r < clog N. 

In proving the above theorem, we will follow the algorithm of [3]. We need the following 
lemma, implicit in [3]: 

Lemma 19. Fix any field F such that Gaussian elimination over F can be performed in 
polynomial time. There is a poly(M,m, |F|) time algorithm for the following problem: Given 
subspaces V\, V2, ■ ■ ■ , V m of F M such that Y^ILi 1^1 < |F| M ; find a point u G F M such that 

Proof. The algorithm will fix the coordinates of u one by one. Assuming that the values 
u\,U2, ■ ■ ■ ,Ui have been fixed for < i < n, let U{ = {w e ¥ M | wj = Uj for 1 < j < «|. The 
algorithm will fix the coordinates of u, ensuring that the following is true: For each i such 
that 1 < % < M, Y^jLi \ v j^ u i\ < Pi\ = |F| M -*. Note that, since U is just F M , the inequality 
is satisfied at i = by the assumption on the size of the subspaces V\, V2, . . . , V m ; also note 
that the inequality is satisfied at i = M if and only if u ^ (L Vi. 
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Assuming u±, u^, . . . have been fixed for i < M, we define, for every a G F, the set C/j )Q , = 
{w G Ui | Wj.fi = a}. Clearly, the sets {Ui t0l } a partition Ui. Hence, we see that Y^JLi \Vj ^ 

Ui\ = Y^ n . v YyjLi \Vj ^ ^i,a\ an d thus, there is some a G F such that X^j=i l^j ^ ^i,al < ^Ff = 

Here is the algorithm: 

• While u\, U2, ■ ■ ■ , Ui have been determined for i < M, do the following: 

— As mentioned above, the following invariant is maintained: ^j=i l^j^^il < 1^*1 = 
|F| M_ \ 

— Find a G F such that £* =1 l^j n t/i, a | < © = |F M - i_1 |. By the reasoning in the 
paragraph above, such an a exists and surely, it can be found in poly(M, k, |F|) 
time using Gaussian elimination. 

— Set Uj + i to a. 

The correctness of the algorithm is clear from the reasoning above. □ 

We now briefly describe the improved algorithm for the RMP. Let P\, P2, ■ ■ ■ , Pk be the input 
matrices. We denote by L the subspace of Y NxN spanned by these matrices. Also, let B r 
denote the matrices of rank at most r. The idea of the algorithm is to "cover" the set L + B r 
by a union of subspaces V\, V2, ■ ■ ■ , V m such that Y^i \ Vi\ < W\ N • We then use the algorithm 
from Lemma [19] to find a matrix P that is not in (L Vi] by the way we have picked the 
subspaces, it is clear that M will then be at rank distance at least r from the subspace L. 

What follows is an important definition. 

Definition 20. Fix positive integers (di,^). Given T, a collection of subspaces of¥ N , we 
say that T is (d\, (I2) -good if: 

• dim(J7) < N -di for each U el 

• Each A C ¥ N of size d-2 is contained in some U G T. 

The following claim illustrates the importance of (d\, <i2)-g°°d subspaces of F^. 

Claim 21. There is an algorithm that, when given as input T, a {d\,d2)-good collection of 
subspaces of¥ N , produces a collections of subspaces of¥ NxN of cardinality at most \T\, with 
the following properties: 

• dim(F) < N 2 — d\N for each V G S. 

• B d2 C \J VeS V 

Moreover, the algorithm runs in time poly(\T\,N). 
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Proof. For each U G T, let V(U) denote the subspace of F generated by all vectors of 
the form uv T , where u G U and v G F . The collection S is the collection of all such vector 
spaces V(U), for U gT. Clearly, the cardinality of S is bounded by |T|. 

Note that a basis for V(E/) can be constructed by picking only to t where u and v range over 
bases for U and F^ respectively. This shows that dim(V(U)) < N 2 — d\N and that V(U) 
can be constructed efficiently 

Finally, given any matrix Q of rank at most cfe, it can be written as a sum of matrices 
Qi + Q2 + • • • + Qd 2 j where each Qj is a matrix of rank at most 1 and hence can be written 
as UivJ, where Ui,Vi G F . Let A = {u%,U2, ■ ■ ■ , Ud 2 }- Since T is (di, d2)-good, there is some 
U G T such that A C U. This implies that u^vj G V(?7) for each i G [^2]- As V(C/) is a 
subspace, it must contain their sum Q. This concludes the proof. □ 

It is easily seen that a random collection of subspaces of F^ of appropriate dimension is 
(d\, G?2)-good for the values of d\ and cfe that are of interest to us. We now assert the existence 
of an explicit collection of subspaces with this property. 

Claim 22. Fix any constant c > 1. For any £, r G N such that £ ■ r < clogN, there is an 
algorithm that runs in time and produces an (£,r)-good collection of subspaces of¥ N . 

We prove the above claim in the next section. Assuming the claim, we can prove Theorem 

us 

Proof of Theorem\18l We will describe an algorithm for the problem. Without loss of gener- 
ality, assume that c > 1. Let L be the input subspace of dimension at most IN. We would 
like to find a matrix P that is at rank distance at least r from L. 

We first use the algorithm referred to in Claim [22] to construct an (I + l,r)-good collection 
of subspaces T of ¥ N in time iV ^. Clearly, |T| = iV°( c ). Then, we use the algorithm of 
Claim I2T1 to construct a collection of subspaces S of Y NxN of size with the following 

properties: 

• dim(V) < N 2 — (£ + 1)N for each V G S. 

• B r C U yeiS V 

Consider the collection of subspaces S' = {L + V \ V £ S}. Clearly, L + B r C \J VeS , V. 
Moreover, the dimension of each subspace in S' is at most £N + iV 2 — (£ + 1)N < N 2 — N. 
Hence, each subspace in S' is of cardinality at most |F| . Since \S'\ = N 0( - c \ for large 
enough N, we have Ev&S' \V\ < \¥\ N . Hence, using the algorithm described in Lemma [T9l 
we can, in time N°( c \ find a matrix P ^ Uye,s' V- By construction, this matrix P is at rank 
distance greater than r from the subspace L. The entire algorithm runs in time 
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7.1 Proof of Claim [H 



We give two different constructions: one for the case that i > r and the other for the case 
that i < r. 

The following notation will be useful. For each i £ [N], let ei £ F^ denote the vector that 
has a 1 in coordinate i and is elsewhere. For any vector x £ F^ and S C [N], we denote by 
x\s the vector in F' 5 ' that is the projection of x to the coordinates indexed by S. 

7.1.1 Case 1: £ > r 

For each A C F 2£ of cardinality r, let be the subspace generated by {x £ ¥ N | x|j 2 £] £ ^4}- 
It is easily seen that dim(VA) <N — 2£ + r<N — I. Moreover, given any A\ C F^ of size 
r , ^-l ^ where ^4 is any subset of ¥ 2e of size r containing {x|[2^ | x £ vli}. Hence, the 
collection T = {V A \ A C F 2<? , \A\ = r) is an (£, r)-good collection of subspaces. 

The cardinality of T is ( |F f") < |F| 2fr = N°( c \ Surely, T can be constructed in time N 0( - c \ 

7.1.2 Case 2: £ < r 

Given a set A C F m for some m £ N, we denote by rank(j4) the size of any maximal set of 
linearly independent vectors from A; we denote by corank(^4) the value (|^4| — rank(j4)). 

Fix a set A C F m for some m £ N. Given d, d! £ N, we say that A is d-wise corank d' if each 
B C A such that \B\ = d satisfies corank(i?) < d'; A is said to be d-wise linearly independent 
if it is d-wise corank 0. Sets that are <i-wise linearly independent have been studied before: see 
[H Proposition 6.5], where matrices whose columns form a d-wise linearly independent set of 
vectors are used to construct d-wise independent sample spaces. The following claim follows 
from this result and from the lower bound on the size of any d-wise independent sample space 
proved in pLj Proposition 6.4]. 

Claim 23 (implicit in pQ). Consider a set A C F m of cardinality t. If A is d-wise linearly 
independent with d < 2\ft, then m > — -|^— ; for large enough d, t. 

Using the above claim, we prove the following lower bound on the size of sets that are <i-wise 
corank d' for suitable d, d' . 

Claim 24. Consider a set A C F' r of cardinality t. There is an absolute constant cq such that 
the following holds. Let A be d-wise corank d 1 for positive integers d, d! with c^d' < d < 2\/t. 
Then, r > d * if t, d, d' are large enough. 

Proof. Denote by d" the value \d/2d' \ . We construct a sequence of sets Aq, Ai,... as follows: 
Aq is the set A; for any i > 0, if Ai has been constructed and is d"-wise linearly independent, 
we stop; otherwise, there is a B C Ai of cardinality d" that is not linearly independent - in 
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this case, we set A+i = Ai\B; we stop at i = d! . It is easy to see that the cardinality ti of A; 
is t — id" . It can also be checked that if A, is dj-wise corank d^, then A+ij if constructed, is 
(di — d")-wise corank d\ — 1; it therefore follows that the set Si, if constructed, is (d — id")-wise 
corank d' — i, for any z > - in particular, S^' is d/2-wise linearly independent. 

We base our analysis on when the above process stops. Let io be the largest i so that A is 
constructed. Its size ti is at least t — d'd" > t — d/2 > t/2 for large enough t. If io = d' , then 
A is a set °f srze a t least t/2 that is d/2-wise linearly independent - by Claim [23l we get 
r > — S^— for large enough d, t. Otherwise, io < d' and we must have Aj is d"-wise linearly 

independent - in this case, by Claim [231 we get r > lo 5 g|F| * > ^"f^ 1 * if cq is large enough. 
Thus, in either case, our claim holds. □ 



Now, we apply the above lemma with t = |F| c o c og and d = co\\/clogN\. We obtain 
the following corollary: 

Corollary 25. Let t, d be as defined above. For large enough N , given any iCF r of size t, 
there is a subset B of A of cardinality d such that corank(S) > I. 



Proof. Assume that A is d-wise corank d' for some d! . We will show that d! > i. For large 
enough N, by Claim [2^1 we have d' > min{^, — } . It remains to be shown that this 
quantity is at least t. 

Note that, since I <r, I 2 < ir < clog N. Hence, t < y 'c log N. Thus, by the choice of d, we 
see that d/co > i. Moreover, 

rflog|F|* > 20c log N 
12r - 127 > 

Hence, we see that d! > t. □ 



We now define the (£, r)-good collection of subspaces. For each 5 C [t] of cardi- 
nality d, and each A C ¥ d of size d — £, let Vs,A De the subspace generated by 
G | x\s = u for some u G yl}. It can be seen that diu^V^A) <N — d + d — £ = N — £ 
for each S, A. 

Given any A\ C of cardinality r, let P G ]p rxJV be the matrix the rows of which are the 
elements of A\. Let A2 denote the set of the first t columns of P. By Corollary [25l there is 
a B C A2 of size (i such that corank(i?) > I. Let S C [f] index the columns of S in P. It 
can be seen that A\ C V5 ,4/ for any A of size d — £ containing a set that spans {v\s \ v G Ai} 
(such an A' exists since corank(£?) > I). 

Thus, we can take for our collection T of (£, r)-good subspaces the collection of all Vs,Ai 
where S C [t] with (S 1 ) = d, and A C F d of size d — £. The size of T is bounded by 
(d) (}J—l) — t d W\ d2 = N°( c \ by our choice of d and t. Clearly, T can be constructed in time 
jV°( c ). 

Acknowledgments. We are grateful to Jaikumar Radhakrishnan for discussions. We also 
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